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Description 

Stereoscopic Parameter Embedding Apparatus and Stereoscopic Image 

Reproducer 

5 Technical Field 
[0001] 

The present invention relates to a technique of generating 
stereoscopic images on the basis of video image data. 

10 Background Art 
[0002] 

A stereoscopic system in which an image for a left eye and an 
image for a right eye, having a given disparity therebeween, are combined 
and displayed is well known. A viewer wears complementary color 
15 glasses or polarized glasses, or uses a lenticular lens or a parallax barrier to 
partially block his/her vision to thereby cause binocular disparity. 
[0003] 

A set of disparity images is typically created by imaging one object 
from two different viewpoints. However, a set of disparity images can be 

20 created from one image taken from a single viewpoint, as is suggested in 
unexamined patent publication No. 2002-123842. A stereoscopic image 
generator described in the publication calculates depth- values from 
saturations of pixels forming an image, discriminates on the basis of the 
depth- values (or corrected depth- values) between a near view and a distant 

25 view of the image, and enlarges a disparity between an image for a left eye 
and an image for a right eye in the near view than in the distant view. The 
algorithm of calculating a depth-value from saturation of a pixel is 
employed in view of an empirical rule that generally a more distant scene 
has a lower saturation and a nearer scene has a higher saturation. 
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[0004] 

Owing to techniques such as that described in the publication, it has 
recently become relatively easy to create, from one image, images which 
have a given disparity therebetween. Accordingly, it is expected that 
5 video content not originally intended for stereoscopic vision will in future 
be subject to a stereoscopic imaging process and marketed in a computer 
readable medium such as a DVD (Digital Video Disc). A purchaser of 
such a DVD will be able to view the video content as stereoscopic images 
using a computer. 

10 

Disclosure of the Invention 

Problems to be Solved by the Invention 

[0006] 

It should be noted that viewing video content as stereoscopic 
15 images places a heavier strain on the eyes of a viewer than does viewing 
the same content as normal two-dimensional images. Therefore, some 
users may wish to view video content which has been processed using 
stereoscopic imaging, simply as two-dimensional images. However, in a 
case where such stereoscopic processed video content is stored on a 
20 medium, it is not possible to then view such content as normal 
two-dimensional images. . 

The present invention has been made in view of the 
above-described circumstances, and provides video content which a user 
can view either as stereoscopic images or as two-dimensional images. 

25 

Means for Solving the Problems 
[0007] 

A computer readable medium according to a preferred embodiment 
of the present invention comprises: a plurality of pieces of video image 
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data to be processed sequentially; and stereoscopic parameters for 
converting a video image into a stereoscopic image, each of which is 
associated with each of the plurality of pieces of video image data. 
[0008] 

5 A computer readable medium according to another preferred 

embodiment of the present invention comprises: a plurality of pieces of 
video image data to be processed sequentially; and sub-picture data to be 
combined with each of the plurality of pieces of video image data, wherein 
the sub-picture data contains stereoscopic parameters for converting a 
10 video image into a stereoscopic image. 
[0009] 

In the embodiments, the computer readable medium may further 
comprise a program for causing a computer to execute a stereoscopic 
imaging process effecting the stereoscopic parameters on the video image 
15 data. 
[0010] 

A stereoscopic parameter embedding apparatus according to another 
embodiment of the present invention comprises: a video image input unit 
operable to input a plurality of pieces of video image data to be processed 

20 sequentially; a parameter input unit operable to input stereoscopic 
parameters for converting a video image into a stereoscopic image, each 
parameter being associated respectively with each of the plurality of pieces 
of video image data; a converter operable to convert each of the input 
stereoscopic parameters into binary data; and an embedding unit operable 

25 to embed bar-code image data corresponding to the binary data in each of 
the plurality of pieces of video image data. 
[0011] 

A stereoscopic parameter embedding apparatus according to another 
embodiment of the present invention comprises: a sub-picture input unit 
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operable to input sub-picture data to be combined with each of a plurality 
of pieces of video image data to be processed sequentially; a parameter 
input unit operable to input stereoscopic parameters for converting a video 
image into a stereoscopic image, each parameter being associated 
5 respectively with each of the plurality of pieces of video image data; a 
converter operable to convert each of the input stereoscopic parameters into 
binary data; and an embedding unit operable to embed bar-code image data 
corresponding to the binary data in each of the pieces of sub-picture data. 
[0012] 

10 In the embodiment, the stereoscopic parameter embedding 

apparatus may further comprises: a video image input unit operable to input 
a plurality of pieces of video image data to be combined with the 
sub-picture data; a video content data preparing unit operable to prepare 
video content data of signals, wherein the sub-picture data with the 

15 embedded bar-code image data and the video image data input via the 
video image input unit are multiplexed in accordance with predetermined 
standards. 
[0013] 

A stereoscopic image reproducer according to another embodiment 
20 of the present invention comprises: a reader operable to read video image 
data to be processed sequentially from a computer readable medium, the 
computer readable medium comprising the video image data and bar-code 
image data, the bar-code image data being prepared through conversion of 
stereoscopic parameters for converting a video image into a stereoscopic 
25 image, into binary data; a bar-code identifying unit operable to identify the 
bar-code image data embedded in the read video image data; a parameter 
extracting unit operable to analyze the identified bar-code image data and 
extract the stereoscopic parameters; a stereoscopic processor operable to 
apply a stereoscopic imaging process on the video image data, the 
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stereoscopic imaging process effecting the extracted stereoscopic 
parameters on the video image data in which the bar-code image data of the 
stereoscopic parameters is embedded; an output unit operable to output the 
stereoscopic-process-applied video image data to a display in a 
5 predetermined sequence. 
[0014] 

A stereoscopic image reproducer according to another embodiment 
of the present invention comprises: a reader operable to read video content 
data from a computer readable medium, the video content data comprising 

10 video image data to be processed sequentially, and sub-picture data to be 
combined with the video image data and in which bar-code image data is 
embedded, the bar-code image data being prepared through conversion of 
stereoscopic parameters for converting a video image into a stereoscopic 
image, into binary data; an extracting unit operable to extract the video 

15 image data and the sub-picture data from the read video content data; a 
bar-code identifying unit operable to identify the bar-code image data 
embedded in the extracted sub-picture data; a parameter extracting unit 
operable to analyze the identified bar-code image data and extract the 
stereoscopic parameters; a stereoscopic processor operable to apply a 

20 stereoscopic imaging process on the video image data, the stereoscopic 
imaging process effecting the extracted stereoscopic parameters on the 
video image data to be combined with the sub-picture data where the 
bar-code image data of the stereoscopic parameters is embedded; a 
combiner operable to combine the stereoscopic-process-applied video 

25 image data with the sub-picture data; an output unit operable to output the 
video image data with the combined sub-picture data to a display in a 
predetermined sequence. 
[0015] 

In the embodiment, the stereoscopic image reproducer may further 
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comprise a bar-code eraser operable to alter the sub-picture data to erase 
the bar-code image data after the bar-code data is analyzed and the 
stereoscopic parameters are extracted from the bar-code image data, 
wherein the combiner combines the video image data with the altered 
5 sub-picture data. 
[0016] 

Also, in the embodiment, the stereoscopic image reproducer may 
further comprise a reproduction system switcher operable to switch 
between reproduction of video image data for stereoscopic viewing and 

10 reproduction of video image data not for stereoscopic viewing, wherein the 
combiner, if reproduction of video image data for stereoscopic viewing is 
selected by the reproduction system switcher, combines the 
stereoscopic-process-applied video image data with the sub-picture data, 
and if reproduction of video image data not for stereoscopic viewing is 

15 selected by the reproduction system switcher, combines the 
pre-stereoscopic-process video image data with the sub-picture data. 
[0017] 

A program according to another embodiment of the present 
invention causes a computer to execute a process, the computer 

20 comprising: a video image input unit operable to input a plurality of pieces 
of video image data to be processed sequentially; and a parameter input 
unit operable to input stereoscopic parameters for converting a video image 
into a stereoscopic image, each of which is associated with each of the 
plurality of pieces of video image data, the process comprising: converting 

25 each of stereoscopic parameters input via the parameter input unit into 
binary data; and embedding bar-code image data corresponding to the 
binary data in video image data input via the video image input unit. 
[0018] 

A program according to another embodiment of the present 
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invention causes a computer to execute a process, the computer 
comprising: a sub-picture input unit operable to input sub-picture data to be 
combined with each of a plurality of pieces of video image data to be 
processed sequentially; and a parameter input unit operable to input 
5 stereoscopic parameters for a video image into a stereoscopic image, each 
parameter being associated with each of the plurality of pieces of video 
image data, the process comprising: converting each of stereoscopic 
parameters input via the parameter input unit into binary data; and 
embedding bar-code image data corresponding to the binary data in 
10 sub-picture data input via the sub-picture input unit. 
[0019] 

A program according to another embodiment of the present 
invention causes a computer to execute a process, the computer 
comprising: a reader operable to read video image data to be processed 

15 sequentially from a computer readable medium, the computer readable 
medium comprising the video image data and bar-code image data, the 
bar-code image data being prepared through conversion of stereoscopic 
parameters for converting a video image into a stereoscopic image, into 
binary data; and a display operable to display a video image, the process 

20 comprising: identifying bar-code image data embedded in video image data 
read by the reader; analyzing the identified bar-code image data to extract 
stereoscopic parameters; applying a stereoscopic imaging process to the 
video image data, the stereoscopic imaging process effecting the extracted 
stereoscopic parameters on the video image data in which the bar-code 

25 image data of the stereoscopic parameters is embedded; and outputting the 
stereoscopic -process-applied video image data to the display in a 
predetermined sequence. 
[0020] 

A program according to another embodiment of the present 
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invention causes a computer to execute a process, the computer 
comprising: a reader operable to read video content data from a computer 
readable medium, the video content data comprising video image data to be 
processed sequentially, and sub-picture data to be combined with the video 
5 image data and in which bar-code image data is embedded, the bar-code 
image data being prepared through conversion of stereoscopic parameters 
for converting a video image into a stereoscopic image, into binary data; 
and a display operable to display a video image; the process comprising: 
extracting video image data and the sub-picture data from the video content 

10 data read via the reader; identifying bar-code image data embedded in the 
extracted sub-picture data; analyzing the identified bar-code image data to 
extract stereoscopic parameters; applying a stereoscopic imaging process 
on the video image data, the stereoscopic imaging process effecting the 
extracted stereoscopic parameters on the video image data to be combined 

15 with the sub-picture data in which the bar-code image data of the 
stereoscopic parameters is embedded; combining the 
stereoscopic-process-applied video image data with the sub-picture data; 
outputting the video image data with the combined sub-picture data to the 
display in a predetermined sequence. 

20 [0021] 

A method of distributing video content data according to another 
embodiment of the present invention, comprises: generating video content 
data representing signals by a first computer comprising: a video image 
input unit operable to input a plurality of pieces of video image data to be 
25 processed sequentially; a sub-picture input unit operable to input 
sub-picture data to be combined with each of the plurality of pieces of 
video image data; and a parameter input unit operable to input stereoscopic 
parameters for converting a video image into a stereoscopic image, each of 
which is associated with each of the pieces of plurality of video image data, 
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the step of generating video content data comprising: converting 
stereoscopic parameters input from the sub-picture input unit into binary 
data; embedding bar-code image data corresponding to the binary data in 
sub-picture data input from the sub-picture input unit; and multiplexing the 
5 sub-picture data in which the bar-code image data is embedded and video 
image data input from the video image input unit in conformity with 
predetermined standards to generate the signals, storing the video content 
data in a computer readable medium and shipping it; causing the video 
content data stored in the computer readable medium to be processed by a 

10 second computer capable of reproducing the video content data; and 
displaying a stereoscopic image of a video image by the second computer, 
comprising: extracting the video image data and the sub-picture data from 
the video content data read from the computer readable medium; 
identifying the bar-code image data embedded in the extracted sub-picture 

15 data; analyzing the identified bar-code image data and extracting the 
stereoscopic parameters; applying a stereoscopic imaging process to the 
video image data, the stereoscopic imaging process effecting the extracted 
stereoscopic parameters on the video image data to be combined with the 
sub-picture data in which the bar-code image data of the stereoscopic 

20 parameters is embedded; combining the 

stereoscopic-imaging-process-applied video image data with the 
sub-picture data; and outputting the video image data with the combined 
sub-picture data to a display in a predetermined sequence. 
[0022] 

25 A computer readable medium according to another embodiment of 

the present invention comprises: two-dimensional image data; and 
stereoscopic parameters for converting a two-dimensional image into a 
stereoscopic image, the stereoscopic parameters being associated with the 
two-dimensional image. 
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[0023] 

A stereoscopic parameter embedding apparatus according to another 
embodiment of the present invention comprises: an image input unit 
operable to input two-dimensional image data; a parameter input unit 
5 operable to input stereoscopic parameters for converting a two-dimensional 
image into a stereoscopic image; a converter operable to convert each of 
the input stereoscopic parameters into binary data; and an embedding unit 
operable to embed bar-code image data corresponding to the binary data in 
the input two-dimensional image data. 
10 [0024] 

A stereoscopic image reproducer according to another embodiment 
of the present invention comprises: a reader operable to read 
two-dimensional image data from a computer readable medium, the 
computer readable medium comprising video image data in which bar-code 

15 image data is embedded, the bar-code image data being prepared through 
conversion of stereoscopic parameters for converting a two-dimensional 
image into a stereoscopic image, into binary data; a bar-code identifying 
unit operable to identify the bar-code image data embedded in the read 
two-dimensional image data; a parameter extracting unit operable to 

20 analyze the identified bar-code image data and extract the stereoscopic 
parameters; a stereoscopic processor operable to apply a stereoscopic 
imaging process to the two-dimensional image data, the stereoscopic 
imaging process effecting the extracted stereoscopic parameters on the 
two-dimensional image data in which the bar-code image data of the 

25 stereoscopic parameters is embedded; an output unit operable to output the 
stereoscopic-process-applied video image data to a display in a 
predetermined sequence. 
[0025] 

A program according to another embodiment of the present 
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invention causes a computer to execute a process, the computer 
comprising: an image input unit operable to input two-dimensional image 
data; and a parameter input unit operable to input stereoscopic parameters 
for converting a two-dimensional image into a stereoscopic image; the 
5 process comprising: converting each of stereoscopic parameters input via 
the parameter input unit into binary data; and embedding bar-code image 
data corresponding to the binary data in two-dimensional image data input 
via the video image input unit. 
[0026] 

10 A program according to another embodiment of the present 

invention causes a computer to execute a process, the computer 
comprising: a reader operable to read two-dimensional image data from a 
computer readable medium, the computer readable medium comprising the 
two-dimensional image data in which bar-code image data is embedded, 

15 the bar-code image data being prepared through conversion of stereoscopic 
parameters for converting a two-dimensional image into a stereoscopic 
image, into binary data; and a display operable to display an image, the 
process comprising: identifying bar-code image data embedded in 
two-dimensional image data read by the reader; analyzing the identified 

20 bar-code image data to extract stereoscopic parameters; applying a 
stereoscopic imaging process on the two-dimensional image data, the 
stereoscopic imaging process effecting the extracted stereoscopic 
parameters on the two-dimensional image data in which the bar-code image 
data of the stereoscopic parameters is embedded; and outputting 

25 stereoscopic image data generated through the stereoscopic process to the 
display. 

Effects of the Invention 
[0027] 
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In the present invention, video data of the video content and 
parameter data for the video content are stored separately on a computer 
medium. When it is desired to view the video content stereoscopically, 
the separately stored video parameter data are used to generate stereoscopic 
5 images from the stored video image data. Since the stereoscopic 
parameters and the video image data are stored separately, the video 
content can be reproduced to be viewed either stereoscopically or 
two-dimensionally 

10 Brief Description of the Drawings 
[0028] 

Fig. 1 is a schematic diagram of a hardware configuration of a stereoscopic 
parameter embedding apparatus. 

Fig. 2 is a hardware configuration diagram of sub-picture data modifier 15. 
15 Fig. 3 is a diagram showing a sub-picture in which a bar-code image is 
embedded. 

Fig. 4 is a flowchart illustrating a data embedding process performed by 
bar-code image embedding unit 15e. 

Fig. 5 is a schematic diagram of a hardware configuration of a stereoscopic 
20 image reproducer. 

Fig. 6 is a hardware configuration diagram of a stereoscopic parameter 
extractor. 

Fig. 7 is a flowchart illustrating a process performed by a bar-code 
analyzer. 

25 

Explanation of the Numerals in the Figures 
[0029] 

10... Time reference signal supplier, 11... Video data encoder, 12... Audio 
data encoder, 13... Parameter memory, 14... Parameter input unit, 
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15... Sub -picture data modifier, 16... Sub-picture data encoder, 
17... Multiplexer, 20... Pick up unit, 21... Demodulator/error corrector, 
22... Demultiplexer, 23... Audio data decoder, 24... Video data decoder, 
25... Reproduction system switcher, 26... Stereoscopic processor, 
5 27 . . . Combiner, 28 . . . Sub-picture data decoder, 29 . . . Stereoscopic parameter 
extractor 

Best Mode for Implementing the Invention 
[0030] 

10 (Embodiment of the Invention) 

Below, an embodiment of the present invention will now be 
described. 

The present embodiment is characterized in that parameters for 
converting a two-dimensional image into a stereoscopic image are 
15 embedded in sub-picture data, which data are multiplexed and stored in a 
DVD (Digital Video Disc) for use when the DVD is played. 
[0031] 

Now, key terms used in the following description will be defined. 

The term "creator" is used to refer to an entity that creates video content 
20 stored on a DVD. The term "user" is used to refer to a person or company 

which purchases and uses a DVD on which created video content is stored. 

The term "video data" is used to refer to data embodying video signals for 

main pictures; the term "audio data" is used to refer to data embodying 

audio signals; the term "sub-picture data" is used to refer to data 
25 embodying video signals for a sub-picture; and the term "video content 

data" is used to refer to data created when the foregoing 3 types of data are 

multiplexed in conformity with defined standards. 

[0032] 

A method of distributing video content data according to the present 
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embodiment includes: a video content creation process; a DVD shipping 
process; a video content obtaining process; and a stereoscopic image 
displaying process. With regard to the description which follows of an 
embodiment of the present invention, a video content creation process and 
5 a stereoscopic image displaying process are characteristic. 

In the video content creation process, a creator obtains video data, 
audio data, and sub-picture data, as source data of video content, and 
embeds bar-code image data in the sub-picture. The bar-code image data 
represents parameters for converting a sequence of video images to be 
10 reproduced based on the video data into stereoscopic images. 

In the DVD shipping process, a creator stores in a DVD, video 
content data containing the video data, the audio data, and the sub-picture 
data in which the bar-code image data is embedded, and ships the DVD for 
marketing. 

15 In the video content obtaining process, a user purchases the DVD, 

and uses an apparatus capable of reproducing both stereoscopic images and 
two-dimensional images (hereinafter, referred to as "stereoscopic image 
reproducer") to read the video content data stored on the DVD. 

In the stereoscopic image displaying process, the user causes the 
20 video content data read by the stereoscopic image reproducer to be 
displayed as stereoscopic images. 

Each of these processes will now be described below. 

[0033] 

(Video Content Creation Process) 
25 The video content creation process will now be described. The 

process is carried out by a creator using a stereoscopic parameter 
embedding apparatus. 

Fig. 1 is a block diagram showing a schematic diagram of a 
hardware configuration of the stereoscopic parameter embedding apparatus. 
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As shown in the drawing, the apparatus includes: time reference signal 
supplier 10; video data encoder 11; audio data encoder 12; parameter 
memory 13; parameter input unit 14; sub-picture data modifier 15; 
sub-picture data encoder 16; and multiplexer 17. 
5 [0034] 

Time reference signal supplier 10 supplies components of the 
parameter embedding apparatus with time reference signal t indicating a 
time that has elapsed since the beginning of reproduction of video content. 
The components of the apparatus synchronize actions for e.g. encoding of 

10 data with reference to the time reference signal t. Intervals at which the 
time reference signal t is supplied correspond to intervals at which a frame 
change of video data takes place. For example, in a case where 30 frames 
of video data are switched per second, time reference signal t is provided at 
1/30 seconds. 

15 [0035] 

In video data encoder 11 video data is input sequentially, and the 
encoder applies compression coding to the input video data in conformity 
with MPEG (Moving Picture Experts Group) standards. The video data 
input in video data encoder 1 1 is a sequence of sets of raster data and a time 
20 stamp. The raster data sets represent, as a bitmap, a video image for a 
respective frame; and the time stamp represents a timing of reproduction of 
the video image. 

In audio data encoder 12 audio data is input sequentially, and the 
encoder encodes the input audio data without compressing it. The audio 
25 data input in audio data encoder 12 consists of a sequence of sets of event 
data, and a time stamp. The event data represents attributes of audio to be 
produced, and the time stamp represents a timing of processing the event 
data. 

The operations of video data encoder 11 and audio data encoder 12 



3270 

16 

are well known from the prior art, and accordingly, detailed description 

thereof is omitted here. 

[0036] 

Parameter memory 13 stores sets of stereoscopic parameters with a 
5 time stamp. The stereoscopic parameters are parameters for converting a 
video image (two-dimensional image) represented by video data for each 
frame into a stereoscopic image, and consist of 11 different types of 
parameters, such as a depth- value (z- value) of each object drawn in a video 
image and a correction value for correcting a depth-value of an object in 

10 accordance with attributes of the object. The stereoscopic parameters 
consist of text data obtained through analysis of a video image represented 
by video data for each frame in accordance with a given algorithm, and the 
obtained stereoscopic parameters are stored in parameter memory 13 in 
association with a time stamp associated with the analyzed video image. 

15 The given algorithm is known in the prior art, and accordingly, detailed 
description thereof will be omitted. 
[0037] 

Parameter input unit 14 reads out, sequentially, a set of stereoscopic 
parameters and a time stamp from parameter memory 13, and inputs them 
20 to sub-picture data modifier 15. 
[0038] 

In sub-picture data modifier 15 sub-picture data is input sequentially, 
and the modifier embeds stereoscopic parameters in the input sub-picture 
data and provides the thus modified data to sub-picture data encoder 16. 
25 The sub-picture data is, unlike the above-mentioned video data, a sequence 
of sets of raster data and control data. The raster data represent a 
sub-picture to be combined with a video image as a bitmap, and the control 
data represent a control method of the sub-picture. # More specifically, the 
raster data consist of sets of attribute data of each pixel forming the bitmap 
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and an address of the pixel A pixel forming subtitles and a pixel forming 
background have different attribute data. Control data contain a time 
stamp representing the timing of starting and terminating of display of the 
sub-picture, and color codes specifying a color of subtitles and a 
5 background color. The color code is a code specifying any of 16 colors 
including white (a transparent color). The control data can contain up to 
four sets of a color code and an attribute value of a pixel. For example, in 
a case where in raster data, subtitles are formed by pixels associated with 
attribute value a, and background are formed by pixels associated with 

10 attribute value b, and where in control data, attribute value a is associated 
with a color code of black, and attribute value b is associated with a color 
code of white, subtitles of the sub-picture are displayed in black and a 
background is displayed in white (a transparent color). In typical 
sub-pictures, the color of subtitles is black, and the background color is 

15 white (transparent color); however, there are some cases where a color code 
associated with a certain attribute value changes depending on a video 
image combined with the sub-picture. 
[0039] 

Fig. 2 is a block diagram showing a hardware configuration of 
20 sub-picture data modifier 15. As shown in the drawing, sub-picture data 
modifier 15 includes: data analyzer 15a; sub-picture data supplementing 
unit 15b; parameter converter 15c; binary data memory 15d; and bar-code 
image embedding unit 15e. 
[0040] 

25 Data analyzer 15a distinguishes, by referring to control data 

contained in sub-picture data, between a time area where subtitles have 
been added and a time area where no subtitle has been added, and in the 
former time area, adds a new time stamp to the input sub-picture data 
before outputting it. Specifically, analyzer 15a updates a time stamp (a 
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time stamp representing the timing of starting display and the timing of 
terminating display) contained in the control data of the sub-picture data 
with a time indicated by time reference signal t before outputting the 
sub-picture data. Accordingly, in a time area where subtitles have been 
5 added, a sequence of sub-picture data is output, wherein raster data have 
not been changed and times indicated by time stamps contained in their 
control data are successive. On the other hand, in a time area where no 
subtitle has been added, sub-picture data and a signal for instructing 
supplementing of the sub-picture data are provided to sub-picture data 
10 supplementing unit 15b. 
[0041] 

Sub-picture data supplementing unit 15b, while the signal is being 
provided from data analyzer 15a to instruct supplementing sub-picture, 
generates new sub-picture data and outputs the data to bar-code image 

15 embedding unit 15e. Raster data of the new sub-picture data does not 
contain data of subtitles. A set of a color code and an attribute value 
contained in control data of the sub-picture is the same as that of 
sub-picture data provided from data analyzer 15a. A time stamp 
contained in the control data indicates the same time as that indicated by 

20 time reference signal t. Namely, in a time area where subtitles have not 
been added, a sequence of sub-picture data is output, wherein raster data 
does not have data of subtitles and times indicated by time stamps 
contained in their control data are successive. 
[0042] 

25 Parameter converter 15c converts stereoscopic parameters into 

binary data. Specifically, parameter converter 15c converts a stereoscopic 
parameter into eight bits of binary data and stores the binary data in binary 
data memory 15d in association with a time stamp associated with the 
stereoscopic parameter. Stereoscopic parameters according to the present 
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embodiment consist of 11 different types of parameters; accordingly, as a 
result of a single conversion, 88 bits of binary data are stored in binary data 
memory 15d. 
[0043] 

5 When binary data for all of 11 types of parameters is stored in 

binary data memory 15d, bar-code image embedding unit 15e generates 
bar-code image data corresponding to the binary data, and embeds the 
bar-code image data in raster data contained in sub-picture data provided 
from data analyzer 15a or sub-picture data supplementing unit 15b. 
10 [0044] 

Fig. 3 is a diagram showing a sub-picture where a bar-code image is 

embedded by bar-code image embedding unit 15e. 

As shown in the drawing, a bar-code image is embedded in a line of 

the third to fifth pixels from the top (hereinafter, referred to as "data 
15 embedding line") of a bitmap of a sub-picture. In the data embedding line, 

blocks of three-by-three pixels (total nines pixels) are arranged laterally. 

Each block corresponds to a bit of binary data which is binary-digitalized 

stereoscopic parameters. The color of nine pixels forming each block is 

associated with the color of either subtitles or background, and it is 
20 determined on the basis of the color of the block whether binary data 

represents "1" or "0". 

[0045] 

As shown in Fig. 3, two blocks from the left extremity L of the data 
embedding line is secured as first leading mark picture area A, and one 
25 block adjoining the right side of the area A is secured as second leading 
mark picture area B. Pixels in first leading mark picture area A are all 
associated with the color of background, and pixels in second leading mark 
picture area B are all associated with the color of subtitles. The marks are 
not used for representing the content of binary data, which is 
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binary-digitalized stereoscopic parameters, but rather are used for 
indicating a starting point of the binary data. An area adjoining the right 
side of second leading mark picture area B is secured as area C for 
representing the content of binary data. Pixels in the area C form laterally 
5 successive 88 blocks, and pixels in each block are associated with the color 
of subtitles or background. 
[0046] 

Fig. 4 is a flowchart of an operation performed by bar-code image 
embedding unit 15e. 

10 At step 100, when sub-picture data is input from data analyzer 15a 

or sub-picture supplementing unit 15b, bar-code image embedding unit 15e 
refers to a time stamp contained in control data of the sub-picture data and 
reads out binary data associated with the same time stamp from binary data 
memory 15d. 

15 At step 110, bar-code image embedding unit 15e identifies, with 

reference to the control data of the input sub-picture data, color codes 
specifying the color of subtitles and the color of background. At step 120, 
bar-code image embedding unit 15e specifies left extremity L of a data 
embedding line of a bitmap represented by raster data contained in the 

20 sub-picture data. 

At step 130, bar-code image embedding unit 15e specifies an area 
of two blocks laterally from left extremity L as first leading mark picture 
area A, and assigns to all pixels in the specified area, an attribute value 
corresponding to the color code of the color of background identified at 

25 step 110. For example, if the color code of the color of background 
indicates white (a transparent color), an attribute value representing white 
(a transparent color) is assigned to the pixels. 
[0047] 

At step 140, bar-code image embedding unit 15e specifies an area 
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of one block adjoining the right side of the first leading mark picture area 
as second leading mark picture area B, and assigns to all pixels in the 
specified area, an attribute value corresponding to the color code of the 
color of subtitles identified at step 110. For example, if the color code of 
5 the color of subtitles indicates black, an attribute value representing black 
is assigned to the pixels, and if the color code indicates blue, an attribute 
value representing blue is assigned. 

At step 150, bar-code image embedding unit 15e divides pixels in 
an area adjoining the right side of second leading mark picture area B into 

10 blocks, and assigns to pixels in each block, an attribute value corresponding 
to the color code of either subtitles or background identified at step 110. 
Which attribute is assigned to the pixels is decided on the basis of the 
binary data read at step 100. For example, if the first piece of the binary 
data read at step 100 represents "1", an attribute value corresponding to the 

15 color code of the color of subtitles is assigned to nine pixels in a block 
adjoining on the right side of the second leading mark picture area. On 
the other hand, if the first piece of the binary data read at step 100 
represents "0", an attribute value corresponding to the color code of the 
color of background is assigned. Bar-code image embedding unit 15e 

20 refers to subsequent pieces of the binary data also, and assigns an attribute 
value to pixels in a block corresponding to each piece of the binary data in 
a similar manner. When assignment of an attribute value to pixels in 
blocks corresponding to all pieces of binary data is completed, at step 160 
bar-code image embedding unit 15e outputs the sub-picture data processed 

25 as described above to sup-picture data encoder 16. 

Bar-code image embedding unit 15e performs the operation as 
described above each time sub-picture data is input from data analyzer 15a 
or sub-picture supplementing unit 1 5b, 
[0048] 
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Returning to description of Fig. 1, sub-picture data encoder 16 
applies a variable length coding on sub-picture data input from sub-picture 
data modifier 15. 

Multiplexer 17 multiplexes code strings output from video data 
5 encoder 11, audio data encoder 12, and sub-picture data encoder 16 to 
generate video content data which is a signal string conforming to DVD 
standards. 
[0049] 

(DVD Shipping Process) 
10 In the present process, the generated video content data is provided 

to a DVD manufacturing factory, and DVDs storing the video content data 
are shipped from the factory into the market. 
[0050] 

(Video Content Obtaining Process) 
15 In the present process, a user owing a stereoscopic image 

reproducer purchases a DVD in the shop, and inserts the DVD into the 
DVD drive of the stereoscopic image reproducer. 
[0051] 

(Stereoscopic Image Displaying Process) 

20 The stereoscopic image displaying process is an operation 

performed by the stereoscopic image reproducer. When the user inserts 
the DVD into the DVD drive of the stereoscopic image reproducer, selects 
a reproduction system between a stereoscopic image reproduction mode 
and a two-dimensional image reproduction mode using a reproduction 

25 system selector (not shown), and instructs start of play of the DVD, the 
stereoscopic image displaying process is started. 
[0052] 

Fig. 5 is a schematic block diagram of a hardware configuration of 
the stereoscopic image reproducer. As shown in the drawing, the 
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stereoscopic image reproducer includes: pick up unit 20; demodulator/error 
corrector 21; demultiplexer 22; audio data decoder 23; video data decoder 
24; reproduction system switcher 25; stereoscopic processor 26; 
sub-picture decoder 28; stereoscopic parameter extractor 29; and combiner 
5 27. 
[0053] 

An outline of an operation of the stereoscopic image reproducer is 
as follows. 

The video content data stored in the DVD inserted into the DVD 
10 drive is picked up by pick up unit 20. An output from pick up unit 20 is 
demodulated by demodulator/error corrector 21, and input to demultiplexer 
22. Demultiplexer 22 divides the video content data input from pick up 
unit 20 into compression-coded signals of audio data, video data, and 
sub-picture data, and provides the compression-coded signals of audio data 
15 to audio data decoder 23, the compression-coded signals of video data to 
video data decoder 24, and the compression-coded signals of sub-picture 
data to sub-picture data decoder 28. 
[0054] 

The compression-coded signals of audio data are decoded by audio 
20 data decoder 23 and provided to a speaker. Specifically, the 
compression-coded signals are decoded into audio data containing sets of 
event data representing attributes of audio to be produced and a time stamp 
representing the timing of processing the event data, and provided to the 
speaker. 
25 [0055] 

The compression-coded signals of video data are decoded by video 
data decoder 24 and provided to reproduction system switcher 25. 
Specifically, the compression-coded signals are decoded into video data 
containing raster data representing a video image and a time stamp 
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representing the timing of reproducing the video image, and provided to 
reproduction system switcher 25. Reproduction system switcher 25 
outputs the provided video data to stereoscopic processor 26 or directly to 
combiner 27. The path of the video data is switched in accordance with a 
5 reproduction system pre-selected by the reproduction system selector (not 
shown). Specifically, if the stereoscopic image reproduction mode is 
pre-selected, the video data is output to stereoscopic image processor 26, 
and if the two-dimensional image reproduction mode is pre-selected, the 
video data is output directly to combiner 27. 
io [0056] 

Stereoscopic processor 26, when the video data is input from 
reproduction system switcher 25, applies a stereoscopic imaging process on 
the video data using stereoscopic parameters provided from stereoscopic 
parameter extractor 29. Specifically, stereoscopic processor 26 generates 

15 an image for a left eye and an image for a right eye, which have a given 
disparity therebetween, on the basis of depth-values included in the 
stereoscopic parameters and their correction values, and combines the 
disparity images. The stereoscopic-imaging-process-applied video data is 
provided to combiner 27. 

20 [0057] 

The compression-coded signals of sub-picture data are decoded by 
sub-picture decoder 28 and provided to stereoscopic parameter extractor 29. 
Specifically, the compression-coded signals are decoded into sub-picture 
data containing sets of raster data representing a sub-picture in which a 
25 bar-code image is embedded and control data of the sub-picture, and 
provided to stereoscopic parameter extractor 29. The control data may 
contain color codes specifying a color of subtitles and a background color, 
and a time stamp for associating the sub-picture and corresponding video 
data. The stereoscopic parameter extractor 29 extracts stereoscopic 
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parameters from the input sub -picture data and provides them to 
stereoscopic processor 26, and provides the sub-picture data to combiner 
27. 

[0058] 

5 Combiner 27 combines the video data input from reproduction 

system switcher 25 or stereoscopic processor 26 with the sub-picture data 
input from stereoscopic parameter extractor 29, and provides the resultant 
data to a monitor. 

The above is an outline of components of the stereoscopic image 
10 reproducer. Below, operation of stereoscopic parameter extractor 29, 
which performs a characteristic operation of the present embodiment, will 
now be described in detail. 
[0059] 

Fig. 6 is a block diagram showing a detailed hardware configuration 
15 of stereoscopic parameter extractor 29. As shown in the drawing, 
stereoscopic parameter extractor 29 includes: sub-picture developing 
memory 29a; bar-code reader 29b; RGB value memory 29c; bar-code 
eraser 29e; bar-code analyzer 29f; binary data memory 29g; and parameter 
decoder 29h. 
20 [0060] 

In sub-picture developing memory 29a a sub-picture represented by 
the raster data contained in the sub-picture data is developed as a bitmap. 
In the data embedding line located at the top of the developed bitmap, a 
bar-code image is drawn, as shown in Fig. 3. 
25 [0061] 

Bar-code reader 29b reads data of the bar-code image from the 
bitmap developed in sub-picture developing memory 29a, and stores RGB 
values corresponding to the data of the bar-code image in RGB value 
memory 29c. Specifically, bar-code reader 29b performs an operation as 
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described below. 

Bar-code reader 29b identifies a starting point of the bar-code image 
on the bitmap developed in sub-picture developing memory 29b. As 
described above with reference to Fig. 3, pixels in two blocks from the left 
5 extremity of the data embedding line, which are first leading mark picture 
area A, are drawn in the background color, and pixels in one block 
adjoining the right side of first leading mark picture area A, which is 
second leading mark picture area B, are drawn in the color of subtitles. 
Accordingly, bar-code reader 29b identifies the data embedding line (a line 

10 of the third to fifth pixels from the top), and refers to pixels in a direction 
towards the right from the left extremity L. When identifying pixels of a 
block (three pixels) not having the background color, bar-code reader 29b 
identifies the right edge of the block as the starting point of the bar-code 
image. Bar-code reader 29b reads pixels of the data embedding line 

15 optically from the identified starting point, and stores an RGB value in 
RGB value memory 29c in association with the address of each pixel. 
The RGB value is evaluated in 255 tones for each of R (Red), G (Green), 
and B (Blue). As an RGB value of a pixel becomes closer to RGB (0, 0, 
0), the color of the pixel becomes closer to white, and as an RGB value of a 

20 pixel becomes closer to RGB (255, 255, 255), the color of the pixel 
becomes closer to black. 
[0062] 

Bar-code eraser 29e, after bar-code reader 29b completes the 
storage of RGB values of pixels in RGB value memory 29c, modifies the 
25 raster data contained in the sub-picture data to erase the bar-code image 
from the data embedding line. Specifically, bar-code eraser 29e writes 
attribute values of three lines under the data embedding line (a line of the 
sixth to eighth pixels from the top) over attribute values in the data 
embedding line. The thus modified sub-picture data is provided to 
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combiner 27. 
[0063] 

Bar-code analyzer 29f generates binary data from the RGB values 
of pixels stored in RGB memory 29c, and stores the generated binary data 
5 in binary data memory 29g. 
[0064] 

Fig. 7 is a flowchart of an operation performed by bar-code analyzer 

29f. 

At step 200, bar-code analyzer 29f divides the RGB values stored in 
10 RGB value memory 29c into groups for each block of nine pixels. Of 
these groups, the group of pixels closest to the starting point of the bar-code 
image is the first to be subjected to a subsequent process. 

At step 210, bar-code analyzer 29f selects one group and discards, 
from among RGB values of pixels belonging to the group, an RGB value 
15 closest to white (0, 0, 0) and an RGB value closest to black (255, 255, 255). 
[0065] 

At step 220, bar-code analyzer 29f determines whether, of the 
remaining seven RGB values, there are more RGB values larger than a 
predetermined threshold than RGB values smaller than the threshold, or 

20 vice versa. The threshold depends on a color code associated with pixels 
forming subtitles in a control code contained in sub-picture data. For 
example, in a case where an attribute value of pixels forming subtitles is 
associated with a color code of black, the threshold is set to 64, which is the 
average of an RGB value. Bar-code analyzer 29f calculates the average of 

25 an R value, a G value, and a B value for each of the seven pixels, and 
determines whether, of the calculated values, there are more values larger 
than 64 than values smaller than 64, or vice versa. In a case where an 
attribute value of pixels forming subtitles is associated with a color code of 
blue, the threshold is set to 64 and is considered against only a B value of a 
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pixel. Bar-code analyzer 29f determines whether of the seven B values 
there are more B values larger than 64 than B values smaller than 64, or 
vice versa. 
[0066] 

5 If there are more RGB values larger than the threshold, at step 230 

bar-code analyzer 29f determines that the pixels of the group being 
processed correspond to "1" and stores binary data representing "1" in 
binary data memory 29g. 

On the other hand, if there are more RGB values larger than the 
10 threshold, at step 240 bar-code analyzer 29f determines that the pixels of 
the group in process correspond to "0" and stores binary data representing 
"0" in binary data memory 29g. 
[0067] 

After storing the binary data, bar-code analyzer 29f proceeds to 
15 select a group of pixels forming a subsequent block and to apply the 
operation from step 210 through step 240 to the group. The operation 
from step 210 through step 240 is repeated until binary data corresponding 
to all blocks are stored. 

In binary data memory 29g binary data ("1" or "0") output from 
20 bar-code analyzer 29f are stored sequentially. When the above operation 
is performed by bar-code analyzer 29f, a total of 88 pieces of binary data 
are generated from data of one sub-picture, and the sequence of binary data 
is stored in binary data memory 29g. For example, a sequence of binary 
data corresponding to the first eight blocks from the starting point of the 
25 bar-code shown in Fig. 3 is "01110010". On the basis of eight successive 
pieces of binary data, a parameter is decoded, as described above. 
[0068] 

Returning to description of Fig. 6, when binary data corresponding 
to all blocks are stored in the binary data memory, parameter decoder 29h 
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reads binary data from binary data memory 29g in chronological order, 
starting with the earliest, and decodes eight pieces of binary data at a time. 
Namely, parameter decoder 29h converts eight successive pieces of binary 
data into text to obtain the original parameters. Parameter decoder 29h 
5 provides the restored parameters to stereoscopic processor 26. 
Stereoscopic processor 26 effects the parameters on video data provided 
from video data decoder 24 as a stereoscopic imaging process. 
[0069] 

In the present embodiment, in the video content creation process, a 

10 creator obtains video data, audio data, and sub-picture data, which are 
source data of video content data to be stored in a DVD, and by analysis of 
video images of the video data, obtains stereoscopic parameters for 
converting the video images to stereoscopic images. The creator embeds 
the stereoscopic parameters in the sub-picture data and multiplexes the 

15 pieces of data to generate video content data. In the stereoscopic image 
displaying process, a user selects a reproduction system between the 
stereoscopic image reproduction mode and the two-dimensional image 
reproduction mode, and instructs playing of the DVD. In a case where the 
stereoscopic image reproduction mode is selected, a stereoscopic image 

20 reproducer identifies the bar-code image embedded in the sub-picture data, 
applies a stereoscopic imaging process to the video data using parameters 
restored from the bar-code image, and causes combiner 27 to output the 
resultant video data. In a case where the two-dimensional image 
reproduction mode is selected, the stereoscopic image reproducer causes 

25 combiner 27 to output the video data without applying the stereoscopic 
imaging process to it. 

As described above, since video data and stereoscopic parameters 
for generating stereoscopic images on the basis of the video data are 
contained separately in video content data, the video content data can be 
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reproduced to be viewed either stereoscopically or two-dimensionally. 
[0070] 

Also, in the present embodiment, stereoscopic parameters are 
converted into binary data and embedded in sub-picture data as a bar-code 
5 image where a bit of binary data is expressed in nine pixels. The bar-code 
image is read optically by a stereoscopic image reproducer, and the 
stereoscopic parameters are restored from the read bar-code image. 
Accordingly, the stereoscopic parameters can be reproduced with great 
accuracy. 
10 [0071] 

Also, in the present embodiment, a stereoscopic parameter 
embedding apparatus, when embedding bar-code image data in sub-picture 
data, identifies the colors of subtitles and background with reference to 
control data contained in the sub-picture data, and embeds a bar-code 

15 image in accordance with the identified colors. Consequently, the color of 
subtitles of a sub-picture is always the same as that of the bar-code image 
embedded in the sub-picture data. Accordingly, a problem can be avoided 
that a change of the color of subtitles makes the recognition rate of a 
bar-code image low. 

20 [0072] 

(Other Embodiments) 

The invention of the present application can be modified in various 

ways. 

In the above embodiment, video images represented by video data 
25 are analyzed to obtain stereoscopic parameters, and bar-code image data 
corresponding to the stereoscopic parameters is embedded in sub-picture 
data. However, the bar-code image data may be embedded in the video 
data. If the bar-code image data is embedded in the video data, the 
stereoscopic parameters restored from the bar-code image data and video 
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data can be matched with a high degree of accuracy. 

The present modification is useful for storing video content data in 
a medium such as a video tape which is not capable of storing multiple 
types of data, unlike a DVD. If bar-code image data is embedded in video 
5 data, images can be viewed via such a medium either stereoscopically or 
two-dimensionally, as in the above embodiment. 
[0073] 

In the above, embodiment, generated video content data is shipped 
for marketing in DVD format. However, the video content data may also 
10 be distributed via a network for a fee. 
[0074] 

In the stereoscopic parameter embedding apparatus according to the 
above embodiment, video content data is generated by hardware logic. 
However, a stereoscopic parameter embedding program for realizing 

15 functions of components shown in Fig. 1, namely, time reference signal 
supplier 10; video data encoder 11; audio data encoder 12; parameter input 
unit 14; sub-picture data modifier 15; sub-picture data encoder 16; and 
multiplexer 17 may be provided in a personal computer to cause a CPU of 
the computer to execute the same operations as those of the components. 

20 Similarly, a stereoscopic image reproduction program for realizing 

functions of components shown in Fig. 5, namely, demultiplexer 22; audio 
data decoder 23; video data decoder 24; reproduction system switcher 25; 
stereoscopic processor 26; sub-picture decoder 28; stereoscopic parameter 
extractor 29; and combiner 27 may be provided in a personal computer to 

25 cause a CPU of the computer to execute the same operations as those of the 
components. 
[0075] 

The stereoscopic image reproduction program may be stored in 
DVD format together with video content data in the video content creation 
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process of the above embodiment, and shipped for marketing. Storage of 
the stereoscopic image reproduction program in DVD format enables a 
personal computer not having the program already installed to install it 
automatically and play the DVD in the stereoscopic image displaying 
5 mode. 
[0076] 

In the above embodiment, moving picture data such as MPEG data 
is subject to a stereoscopic imaging process. However, two-dimensional 
static image data such as JPEG (Joint Photographic Experts Group) data 
10 and GIF (Graphic Interchange Format) data may be subjected to the 
stereoscopic imaging process. In this case, the static image data is 
analyzed to obtain stereoscopic parameters, and a bar-code image 
corresponding to the parameters is embedded in the static image data. 



